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A Counter-example  and  Correction  to  a Theorem  of  Venter 


Let  H be  a set  and  (T^,  n = 1, 2, ...)  a sequence  of  transfor- 
mations of  H into  itself.  Let  X,  and  (U  ) be  random  elements 

i n 

in  H and  generate  the  sequence  (X^)  by 


X , . = T (X  ) + U 
n+1  n n n 


Theorems  giving  conditions  under  which  (Xfi)  is  "stochastically 
attracted"  towards  a given  subset  of  H and  win  eventually  be  with- 
in or  arbitrarily  close  to  this  set  (in  some  sense)  are  called 
Dvoretzky  stochastic  approximation  theorems. 

In  this  note  we  point  out  that  one  such  theorem  due  to  Venter 
(1966)  is  erroneous  by  giving  a counter-example.  We  also  rectify 
this  by  strengthening  one  of  the  conditions  required  by  Venter.  For 
the  sake  of  easy  reference  we  quote  the  theorem  under  discussion 
(Theorem  3 in  Venter  (1966)). 


Theorem: 


Let  H be  a real  separable  Hilbert  space  with  inner  product 
(•,*)  and  norm  Let  X be  the  o- field  of  subsets  of  H gen- 

erated by  the  open  sets.  Let  (n, Q,p)  be  a probability  measure 
space;  the  elements  of  Q are  generically  denoted  by  uu  . Let  S 


be  a transformation  of  HxQ  into  H.  Let  Tn  be  specified  by 


T (x.,....x  ,uu)  = x - S (x  ,w) 
n 1*  * n*  n n w 
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and  suppose  that  Sn  satisfies  the  following  conditions.  For  each 
x € H and  uu  € € <2  where  P(ftQ)  = 1> 

Hsn(x,u;)|l2  S ejx  - e||2  + 6n 

for  all  n,  where  &n  are  non-negative  real  sequences  such  that 

Zp  < 09  Z&  < « . 
n * n 

Also  for  each  e > 0,  define 

c (e,u>)  = lim  2(x-0,S  (x,io)) 

e^||x-e||^-i  n 

and 

(a)  suppose  that  there  is  a finite  integer  valued  random  variable 
Nc  such  that  for  all  n > N.  (<ju)  and  for  all  ou  € ftp, 

(1)  cn(e,u>)  a &n 
while  also 

(2)  Zcn(e,u>)  = • 

(the  italics  are  ours). 

Define  (Xr)  by 

2 

X1  is  arbitrary  with  EX^  < 

Xn+1  = Tn^Xl^,**,,Xn^,u^  + Un^ 

where  (Un)  is  a sequence  of  random  elements  satisfying  the  condi- 
tions 

i 
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(3)  z E||un||2  < » 

and 

00  2l[E[Un|/3n]  11  < ® a.s. 

where  (B^)  is  an  increasing  sequence  of  sub  a -fields  of  G having  the 
properties  that  the  random  elements  (3^,  . . .,Xn,T(X^), . . .,Tn(X^, . . .,Xn)} 
are  measurable  with  respect  to  6 for  n = 2,3...  and  that 

[co  € ft  : n > N£(uj)]  6 B . 

then  xn  -*  9 a.s.  as  n -*  <*> . In  addition  if  Ng  is  degenerate  and 
(Un)  satisfies  (3)  and  instead  of  (4) 

Z(EllE[Unl^n]H2)1/2  < «. 

Then  e[1x  — 0|J  -♦  0 as  n -»  ». 

The  theorem  as  stated  is  false  as  can  be  seen  from  the  following 
example . 

Example: 

Let  M be  a mapping  from  R to  R such  that 

rx  for  | x | si 

M(x)  ={ 

V.  0 for  |x|  >1  . 

Then  x M(x)  > 0 for  0 / |x|  £ 1 

and  |m(x)|  i c|x|  for  |x|  s 1 with  0 < C £ 1 
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X,  be  a fixed  real  number  and  define  X for  n £ 2 recur- 
1 n 


sively  by 


X ^ = X - n_1M(x  ). 
n+1  n n 


Clearly  if  |x^|  > 1 then  X^  = X^  for  all  n.  Thus  for  every 

0 < a < C,  n®X  -♦  ® and  n2aEX 2 = E(n®X  )2-»  ®. 

’ n n n 

On  the  other  hand  as  we  shall  see  the  process  Y = n^  with 

n n 

a = min(l/2,  c) 

satisfies  all  the  conditions  of  Venter's  theorem. 


n*X  = Y 
n n 


Yn+1  = (n+1)\  - (n+l)&  n’1  M<xn) 

= (l+n_1)a  Y - (n+l)a  n"1  M(n_aY  ) 


Thus  using  the  notation  of  the  theorem. 


Sn(x,iu)  = Sn(x)  = (n+l)a  n-1  M(n”ax)  - [ (l+n-1)a  - l]x 
= (n+l)a  n-^  M(n  ax)  - [an  ^ + 0(n“2)]j 


Hence 


|sn(x)|  £ (n+l)a  n-1-a  | x | + [an~x  + 0(n“^)3 |x| 
s | x | [(l+a)n-1  + 0(n-2)] 


-1  . «/  -2, 


Pn  = 2(l+a)2  n-2  + 0(n”^)  and 

6_  = 0 
n 
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Clearly  ZPn  < 00  and  2&n  < 00  • Further 

2x  Sn(x)  = 2(n+l)a  n-1  |x|  |M(n"ax)|  - 2[an_1  + 0(n~2)]x2  . 
Let  n be  so  large  that  e”1  n"a  < 1.  Then  for  e £ |x|  £ e-1 

|M(n  ax) | 2:  c|xn~a| 

and  therefore 

2x  Sn(x)  = 2(l+n"1)aCn_1  |x|2  - 2[an_1  + 0(n"2)]x2 
= 2 | x | 2 n-1[(l+n  ^)aC  - a + 0(n-2)] 

= 2|x|2  n 1[C  - a + 0(n  2)] 


2 —X  — 2 

Thus  Cn(e,uj)  = Cn(e)  = 2e  n [C  - a + 0(n  )]  and  so 

2 Cn(c)  = » 

and 

C (e)  2 & if  n>N  where  N is  given  by 
n n e e 

(eN®)"1  < 1. 


Thus  all  the  conditions  are  satisfied  but  the  conclusion  is  obviously 
wrong. 

The  error  in  Venter's  proof  is  as  follows:  Venter  uses  a 
theorem.  Theorem  1 in  the  same  paper  to  prove  Theorem  3 in  his  paper. 
Theorem  1 assumes  (among  other  things)  that 

llT„<v-v  u>)  - e\\2  £ max[a,  (lJ-Pn)|lxn  “ g\\?‘  - Yn3  where 


(5) 
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But  in  the  proof  of  Theorem  3,  Venter  shows  that  for  any  e > 0 and 
all  (x^)  such  that  sup||xn||  < e 1 , (5)  holds.  But  then  N(<ju)  de- 

pends on  € and  Theorem  1 is  not  applicable. 

The  theorem  can  be  corrected  if  Condition  A is  changed  to  read: 
"there  exists  a finite  integer  valued  random  variable  N (instead 
of  N£)  such  that  (l)  and  (2)  hold". 


Acknowledgements : I would  like  to  express  my  thanks  to  Professor  S. 
Zacks  whose  problem  led  to  this  discussion  and  Professor  D.  Anbar 
for  his  extraordinary  help  in  writing  this  note. 
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